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Abstract 

In this paper, a new definition of observability is introduced for 
PDEs. It is a quantitative measure of partial observability. The quan- 
tity is proved to be consistent if approximated using well posed ap- 
proximation schemes. A first order approximation of an unobservabil- 
ity index using empirical gramian is introduced. For linear systems 
with full state observability, the empirical gramian is equivalent to the 
observability gramian in control theory. The consistency of the defined 
observability is exemplified using a Burgers' equation. 

1 Introduction 

Observability is a fundamental property of dynamical systems [6', 'T] that has 
an extensive literature. It is a measure of well-posedness for the estimation 
of system states using both sensor information and non-sensor knowledge. It 
is impossible in this paper to review all the main results on this subject while 
some interesting work can be found in [H El [13] for nonlinear systems, p!5] 
for PDEs, |llj for stochastic systems, and [H] for normal forms. For com- 
plicated problems, the challenge is to define the concept so that it captures 
the fundamental nature of observability, and meanwhile, it is practically 
verifiable. In [8l[9], a definition of observability is introduced using dynamic 
optimization as a tool. This concept is developed in a project of finding the 
best sensor locations for data assimilation, a computational algorithm widely 
used in numerical weather prediction. Different from traditional definitions 
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of observability, the one in [8l |9] is able to collectively address several is- 
sues in a unified framework, including quantitatively measure observability, 
determine partial observability, accommodate both sensor and non-sensor 
information, etc. Moreover, computational methods of dynamic optimiza- 
tion provide practical tools to numerically approximate the observability of 
complicated systems that cannot be treated using an analytic approach. 

To extend the defintion of observability in [8l E] to systems defined by 
PDEs, several fundamental issues must be addressed. A partial observ- 
ability makes perfect sense for infinite dimensional systems such as PDEs. 
However, its computation must be carried out using finite dimensional ap- 
proximations. It is known in the literature that an ODE approximation of a 
PDE may not preserve the property of observability, even if the approxima- 
tion scheme is convergent and stable [ISIE]- Therefore, to apply the concept 
of observability to PDEs, it is important to understand its consistency in 
ODE approximations. 

In Section [2l some examples from existing literature are introduced to 
illustrate the issues being addressed in this paper. Observability is defined 
for PDEs in Section [3l In Section HI a theorem on the consistency of observ- 
ability is proved. The relationship between the unobservability index and 
an empirical gramian is addressed in Section [5l which serves as a first order 
approximation of the observability. In Section [6l the concept is extended 
to nonlinear systems and a theorem of consistency is proved. The theory is 
verified using a Burgers' equation in Section [71 

2 Some issues on observability 

Consider the initial value problem of a heat equation 

ut{x,t) = Uxx{x,t), X £ [0,L],t G [0,r] 
n(0,t) = u{L,t) = 

Suppose the measured output is 

y{t) = u{xo,t) 



2 



for some xq £ [0,L]. In this example, we assume L = 27r, T = 10, and 
xq = 0.5. Suppose the solution and its output has the following form 



u{x, t) = Uk{t) sin 



k=l 



kirx 



l{t) = y^Hfc(t)sin 



k=l 



L 

/ kTTXo \ 



Then the Fourier coefficients satisfy the following ODE 
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A A^th order approximation of the original initial value problem with output 
is defined by a system of ODEs 



du 



N 



y = C^u^ 



N 



(2.1) 



A gramian matrix [7] can be used to measure the observability of Uq . More 
specifically, given A > the observability gramian is 



W 



T 



Its smallest eigenvalue, measures the observability of Uq . A small 

value of implies weak observability. If the maximum sensor error is e, 
then the worst estimation error of is 



CT, 



N 



(2.2) 
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The system has infinitely many modes in its Fourier expansion. However, 
it has a single output. The computation shows that the output can make 
the first mode observable. However, when the number of modes is increased, 
their observability decreases rapidly. From Figure [H for = 1 we have 
^min ~ 1-216, which implies a reasonably observable ui(0). However, when 
N is increased, the observability decreases rapidly. For = 8, cr^-^ is 
almost zero, i.e 

[ ui{0) mio) ■■■ usio) f 

is extremely weakly observable, or practically unobservable. According to 
(12. 2p , a small sensor noise results in a big estimation error. 
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Figure 1: Observability of heat equation 

The family of solutions of a PDF is an infinite dimensional space. Finite 
many sensors may not provide adequate information to accurately estimate 
all modes in an initial state. In the example of heat equation, a single 
output makes the first two or three modes observable. All other modes are 
practically unobservable. On the other hand, in practical applications a 
finite number of modes is enough to provide accurate approximations. All 
we need is the observability of the finite modes. This is the reason we would 
like to measure a system's partial observability. The concept is useful not 
only for PDEs. In large scale systems with high (finite) dimensions, it may 
not be possible or necessary to make the entire state space observable. A 
partial observability is all we need. 

Another issue to be addressed in this paper is consistency. In general 
the observability for PDEs is numerically computed using a system of ODEs 
as an approximation. However, it is not automatically guaranteed that the 
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observability of the ODEs is consistent with the observabihty of the original 
PDE. In fact, a convergent discretization of a PDE may not preserve its 
observability. Take the following wave equation as an example 



Utt - Uxx = 0, 

u{0,t) = u{L,t) = 0, 
u{x,0) = uo{x),Ut{x,0) 



Ui{X) 



0<x<L, 0<t<T 
<t<T 
< X < L 



(2.3) 



It is known that the total energy of the system can be estimated by using 
the energy concentrated on the boundary. However, in [TS] it is proved that 
the discretized ODEs do not have the same observability. The energy of 
solutions is given by 

E{t) = 11 {\ut{x,t)\'^ + |n^(x,t)p) dx 
^ Jo 

This quantity is conserved along time. It is know that, when T > 2L, the 
total energy of solutions can be estimated uniformly by means of the energy 
concentrated on the boundary x = L. More precisely, there exists C(T) > 
such that ^ 

E{0)<C{T) [ \ux{L,t)\^dt (2.4) 
Jo 

Now consider the discretized system using a finite difference method, 
Uj+i(t) + Uj-i{t) - 2uj{t) 



Uo{t) = UN+lit) = 0, 



0<t <r, j = 1,2, 

< t < T 

1 = 0,l,---,iV + l 



(2.5) 



The total energy of the ODEs is given by 

h ^ 



j=0 



Uj + i{t) - Uj{t) 



h 



This quantity is conserved along the trajectories of the ODEs. The energy 
on the boundary is defined by 



dt 



f 


UN{t) 


10 


h 



Because the solutions of ()2.5p converges to the solutions of ()2.3p . we expect 
that the total energy of (12. 5p can be uniformly estimated using the energy 
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concentrated along a boundary, i.e. the following inequality similar to (j2.4p 
holds for some C(T) uniformly in h, 



Eh{0) < C{T) [ 



Jo 



■T 



UN{t) ^ 

h 



dt 



However, it is proved in [15] that this inequality is not true. In fact, the ratio 
between the total energy and the energy along the boundary is unbounded 
as /i — )• 0. To summarize, the observability of a PDE is not necessarily 
preserved in its discretizations. 

In this paper, we introduce a quantitative measure of partial observabil- 
ity for PDEs. Sufficient conditions are proved for the consistency of the 
observability for well posed discretization schemes. 

3 Problem formulation 

Following [1], we formulate a linear evolution problem 



where Q is an open set in M^, £ is a linear operator, bounded or unbounded, 
in its domain D{C), which is a subspace of a Banach space {X, || • | In the 
following, u{t) represents u{-,t) G D{C). The boundary condition is defined 
by a set of linear boundary operators on a part of dVL, denoted by 50;,. To 
take into consideration of the boundary condition, we define 



We consider the family of solutions, in either strict or weak sense, generated 
by u{Q) G Db{C). The right-hand side 5 is a continuous function of the 
variable t with values in X, i.e g G C{[tQ,ti\,X). A solution u{t) for this 
problem is a X valued function that is continuous in [to, ^i], du/dt exists and 
is continuous for all t G [t^^ti], satisfying n(0) = uq, and u{t) G Db{C) for 
all t G (0, ti]. We assume that p. ID is a well posed problem in the Hadamard 
sense ([Hill]). More specifically, 

• For any uq G Db{C), (|3.ip has a solution. 

• The solution for uq G Db{C) is unique. 



ut + Cu = g, 
Bu = 

U = Uq 



in (7 X {tQ,ti\ 
on (90fe X (to, ii] 
in X {t = 0} 



(3.1) 



y{t)='H{u{;t)) 



Db{C) = {u G D{C)\ = on aj^b} 
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• The solution of (|3.ip depends continuously on its initial value. 

In y{t) = 'H{u{-,t)) represents the output of the system in which H is 

a linear operator from X to MP. The output y{t) G C([to,ii]) has a norm 
denoted by ||?/||y. Rather than the entire state space, the observability is 
defined in a finite dimensional subspace. Let 

W = span{ei,e2, ■■■ ,es} 

be a subspace of Db{C.) generated by a basis {ei, 62, • • • , Cs}. In the follow- 
ing, we analyze the observability of ti(0) using estimates from W . Therefore 
W is called the space for estimation. 

Let u{t) be a solution of Suppose Uy^ifi) generate the best estima- 

tion of ii(0) in W in the sense that Uu]{t) minimizes the following output 
error, 

minll'H(n^) - 'U{u)\\y 
subject to 

duw/dt + Cuw = g (3-2) 
Un,{t) G Db{C) for aU t G [toM] 
Uu,{Q) G W 

Let Ur{t) = u{t) — Uw{t) be the remainder, then 

u{t) = Uw{t) + Ur{t) (3-3) 

According to (j3.2p . the best estimate of ii(0) in 14^ is u^(0). The estima- 
tion error, ||iir(0)||x, is not directly caused by the output noise, i.e. this 
error of remainder cannot be reduced no matter how accurate the output is 
measured. Therefore, the following partial observability is defined for Uw{0) 
only. Or equivalently, we assume n(0) G in the definition. 

Definition 1 Given a nominal trajectory u of \3. ij) with u(0) G W . For a 
given p > 0, define 

e = inf ||?^(n) -?^(n)||y (3.4) 

where u satisfies 

ut + Cu = g 

u{t) G Db{C) for all t G (to, ^i] ,0 
«(0) G W 

\\u{Q)-u{mx = p 

Then p/e is called the unobservability index ofu{0) along the trajectory u{t). 
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Remark. The ratio p/e can be interpreted as follows: if the maximum error 
of the measured output, or sensor error, is e, then the worst estimation error 
of u{0) is p. Therefore, a small value of p/e implies strong observability of 

Remark. If n(0) is not in W, then the overall error in the estimation 
of n(0) is bounded by the error of the estimate of Uw plus the remainder, 
or the truncation error, ||tir(0)||x- For tt(0) to be strongly observable, it 
requires a strong observability of Uw{0) and a small remainder Ur(0). 

Remark. If u{0) = rn]{0) + Ur{0) is not in W, in order to compute the 
observability of n^(0) one must solve (j3.2p first to find li^o (0). In fact, this 
is not necessary. Given any solution of (|3.5p . It can be expressed as 



u{t) = Uw{t) + 5u{t) 
where 5u{t) is a solution of the associated homogeneous PDE and 

<5u(0) Giy, \\5u{mx=P 



Therefore, 



Because 



u{t) + Ur{t) = tito(t) + Ur{t) + 5u{t) 

= u{t) + 5u{t) 

\\'H{u)-nM\\Y 

= \\H{u + Ur) - l-L{Uw + Ur)\\Y 

= U{u + 5u)-U{u)\\y 



(3.6) 



the dynamic optimization (I3.4p - (I3.5|) is equivalent to 

e = inf ||?^(n) -?^(n)||y 
subject to 
ut + Cu = g 

u{t) G Db{C) for ah t G (to,ti] 
u(0) (^u + W 
\\u{Q)-u{mx = P 

In (|3.6p . it is not necessary to compute Uw(t). 

Remark. It can be shown that, for linear problems, p/e is a constant. 
The expressions in ()3.4p - ()3.5p can be simplified (See Section [5]). However, 



8 



we prefer the form adopted in Definition [T] because it can be easily general- 
ized to nonlinear problems 



To numerically compute a system's observability, (j3.ip is approximated 
by ODEs. In this paper, we consider a general approximation scheme using 
a sequence of ODEs, 



n^(0) = ^"^-^^ 

where N > Nq for some integer Nq. The approximation is constructed using 
two linear mappings 

: D{C) ^ JR^ 

In addition, a norm, || • Htv, is defined on ]R^ . The approximation scheme 
is said to be well posed if it satisfies the following conditions. 

• Given any solution u{t) : [to,ti] — Db{C), of ()3.ip . Suppose u^{t) is 
a solution of (|3.7p satisfying n^(0) = P^(n(0)), then 

lim ||cI>^(^z^(t))-tx(t)|U=0 (3.9) 

converges uniformly on [toi^i]- 

• For any u ^ X, the sequence defined by = P^u satisfies 

lim IIu^IIat = \\u\\x (3.10) 

Given the space for estimation W ^ we define a sequence of subspaces, 
C JR^, by 

= P^{W) 

They are used as the space for estimation in iR^. If {ei, 62, • • • , eg} is a basis 
of W ^ then their projections to are denoted by 

ef = P^(e,), i = l,2,---,s 

So PF^ = span{ef,ef,---,ef}. 

Example. For a spectral method, approximate solutions can be expressed 
in terms of an orthonormal basis 



{g7v(2;) :iV = 0,1,2, •••} 
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For any function, 

oo 

v{x) = '^VkqN{x) £ D{C) 

k=0 

one can define 

P^{v) = [ Vo Vi ■■■ VN ] 

Obviously, ^-'^ is defined by 

N 

^^{[vq Vi ■■■ VN ] ) = VkQN 

k=0 

Because tlie basis is orthonormal, the P norm and the inner product in 
is consistent with those in L'^{Q). □ 

Example. Some approximation methods, such as finite difference and finite 
element, are based on a grid defined by a set of points in space, 

{Xk}k=l 

and a basis {g^} satisfying 



Qk[Xj} 



1 k = j 

0, otherwise 



In this case, the mappings in the approximation scheme is defined as follows 

P^{v)=[v{xi) V{X2) ••• v{xn) 

N 

^^{[vi V2 ■■■ VN ] ) = VkQk 

k=l 



The inner product in M can be induced from the L space, i.e. for u,v £ 



N N 
<u,v >N=< '^UkQk^^Vkqk > 

k=l k=l 

If the functions in D{C) are uniformly continuous, then con- 
verges to V uniformly. It can be shown that < •, • >Af is consistent with the 
inner product in L^(il).n 

Following [8j, we define the observability for ODE systems. 
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Definition 2 Given p > and a trajectory u^{t) of jg. 7\ ) with n^(0) G 
W^. Let 

= infill^ o <^^{u^) - n o <i>^(n^)||y 

where satisfies 

du^/dt + A^u^ = 

«^(0) G (3.11) 
||n^(0)-n^(0)|U = /5 

T/ien /o/e^ is called the unobservability index ofu^{0) in the space W'^ . 

4 The consistency of observability 

In this section, we address the consistency of observabihty. The theorem is 
based on a continuity assumption. In the problem formulation, the output 
mapping Ti is not required to be bounded. However, in the proof of the 
consistency theorem we require Ti be continuous in the following subspace 
of X extended from W 

We = span {{ei, e2, • • • , ej U {1>^(ef ), • • • , $^(ef 

Output Continuity Assumption: Given a sequence 

{vk{t)}T=ko^c\[to,h],WE) 

If Vk{t) converges to v{t) in We uniformly on [tojii], then 

lim n{vk) = n{v) 

This assumption is automatically satisfied if is a bounded linear op- 
erator. Or if We has a finite dimension, then this assumption is satisfied 
even if the operator is unbounded in X. 

Theorem 1 Suppose the initial value problem \3. l\l and its approximation 
scheme 7p -( rO|) are well posed. Suppose % satisfies Output Continuity 
Assumption. Then, 

lim = e f4 i) 

To prove this theorem, we need the following lemma. 

Lemma 1 Given a sequence (t), N > Nq, satisfying 113.11]) . Then there 
exists a subsequence, n^*(t), so that {^'^'^ {u'^'' {t))}'^i converges uniformly 
to a solution of ^3.5]) . 
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Proof . Let u{t) be a solution of the original PDE with initial value 

n(0) = 

and let i = 1, 2, • • • , s, be the solution of the associated homogeneous 

PDE with initial value ej, i.e. 

dhi/dt + Ch = 0, 'mClx{tQ,ti] 

Bu = on dftb -X {to, h] (4.2) 

u = ei in n X {t = 0} 

Then any solution of the nonhomogeneous PDE with an initial value in W 
has the form 



+ ^i^i (4-3) 



u 

i=l 

For each A^, define {t) be the solution of an approximating ODE satisfying 

n^(0) = 

We know that '^^{u^) approaches u uniformly as — )• cxd. Let hf{t), 
i = 1,2, ■ ■ ■ , s, be the solution of the associated homogeneous ODE with 

N 

, i.e. 

dhf/dt + A^hf = 
/if (0) = e 

Then <I>^(/if (t)) approaches hi{t) uniformly as — )• oo. For each u^{t) in 
Lemma dl it can be expressed as 



initial value ef , i.e. 



iv7n^ - - (4.4) 



(t) = n^(t) + ^af/.f(t) 



i=l 

and 

n^(0) = ^afef 

i=l 

From the initial condition in ()3.1ip . we know that the set 



2=1 
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is bounded. Because the norms are consistent, we can prove that the se- 
quence {{o-i , a2 , ■ " , 0'T)'^}'n=No ^ bounded subsequence which con- 
verges under the standard norm || • 1 12- Let {(of^*', a^*" , • • • , a^'')'^}'^=i be the 
convergent subsequence with a Umit (ai, a2, • • • , a^)-^. Then 

Hm 

k—¥oo 

s 

= lim (^^H^^H*)) + y^af'^^H^'W)) 

k^oo ^ — ' 
i=\ 

s 

= u{t) + y^^aihijt) 

i=l 

The hmit converges uniformly. From (j4.3p . u{t) must be a solution of the 
PDE in ([33]). Because 

||n^'=(0)-n^HO)IU, =P 
and because of the consistency of the norms, we have 
||u(0) -^i(0)||x 

s 

= hm ||^a.ef'=-n^HO)lk, 

i=l 
s 

= hm II J^a^e^-^^HO)!^, 

1 = 1 

= P 

Therefore, {^>^'= ('U^'=)}^^ converges uniformly to a solution of ()3.5p . □ 

Proof of TheoremUl First, we prove 

liminfe^>e (4.5) 

Suppose this is not true, then liminf < e. There exists a > and a 
subsequence ^ oo so that 

e^" <e-a 

for all Nk- From the definition of e^, there exist u^'^{t) satisfying ()3.1ip 
such that 

||?^o$^fc(n^fc) -7^o$^fc(u^fe)||y < e-a 



13 



From Lemma dl we can assume that [u^'' ) converges to u uniformly and 
u satisfies (|3.5p . From Output Continuity Assumption, 

lim ||?^o$^''-(n^'=) -?^o$^'=(u^'=)||y = Wniu) - 'H{u)\\y <e-a 

k—^oo 

However, from the definition of e, we know 

e < wniu) - 'H{u)\\y 

A contradiction is found. Therefore, (|4.5p must hold. 
In the next step, we prove 

lim sup < e (4.6) 

It is adequate to prove the following statement: for any a > 0, there exists 
iVi > so that 

< e + a (4.7) 



for all N > Ni. From the definition of e, there exists u satisfying (|3.5p so 
that 

\\'H{u)-'H{u)\\y <e + a (4.8) 
Let be a solution of the ODE 

du^'/dt + A^n^ = 5^ 

with the initial value 

{0) = {u{0)) 
Then the following limit converges uniformly 

hm \\^''iu^{t))-uit)\\x=0 (4.9) 

A problem with u^{0) is that its distance to n^(0) may not be p, which is 
required by (I3.1ip . Let us define 

^ P 

||ti^(0)-n^(0)|U 

Then u{t) satisfies (jS.lip . Due to the consistency of the norms and the fact 
\\u{0) — u{0)\\x = p, we know 

lim = 1 

N^oo 
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From (j4.9p . we have 

converges uniformly to u — u. Output Continuity Assumption and (j4.8p 
imply 

lim ||?^o$^(n^) -^o$^(n^)||y 

= ||?^(n)-7^(n)||y 
< e + a 

This implies that there exits A'^i > so that 

\\no^^{u^)-'Ho^^{u^)\\Y <e + a 

for all N > Ni. From the definition of e^, we know 

e"" <\\no ci>^(n^) - n o $^(tx^)||y < e + a 

for all N > Ni. Therefore, (jM]) holds. 

To summarize, the inequalities (14. Sp and (14. 6p imply 

lim = e 

Af-)-oo 

□ 

5 Empirical gramian matrix 

In this section, we assume that W'^ and the space of y{t) are both Hilbert 
spaces with inner products <,>Ar and < •,• >y, respectively. Then / p 
equals the smallest eigenvalue of a gramian matrix. More specifically, let 

{s-i , • • • , e^} 

be a set of orthonormal basis of . For any {t^ satisfying (j3.1ip . we have 

= e-^'^*(u^(0)-n^(0)) 

k=l 

for some coefficients satisfying 

s 

k=l 
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Therefore, 

< n o ^^{u^{t) - u^{t)),no ^^{ii^it) - u^{t)) >N 

k=l 1=1 

= [ ai 02 • • • as ]G[ ai a2 ■■■ ] 
where G is the gramian 

G = [ G.J ]^,, , G., =< n o c|.A^(e-^"*ef ),?^ o $^(e-^"*ef ) >y 

(5.1) 

This matrix is the same as the observabihty gramian if is the entire 
space and if y{t) lies in a space. It is straightforward to prove 

(e^)2 = mm<no<^{u{t)-u{t)),'Ho^{u{t)-u{t))>N 

rp 

= min [ oi 02 • • • o^ ] G [ oi 02 • • • o^ ] 

2 

— ^minP 

where cTmin is the smallest eigenvalue of the gramian G. To summarize, if 
ti^(O) and y{t) lie in Hilbert spaces, then the unobservability index of the 
discretized system can be computed using the smallest eigenvalue of the 
gramian (|5.ip 

p/e^ = (5.2) 

Y 'J min 

If {e^ , 62 , • • • , e^} is not an orthonormal basis, then 

(e^)2 = min [ oi 02 ••• ] G [ oi 02 ••• as 
subject to 

= [ ai 02 • • • Os ] 5 [ oi 02 • • • tts ] 



where 

Sij=<ef,ef>N (5.3) 

Let 

'^min be the smallest eigenvalue of G relative to 5", i.e. 

G^ — ^minSS, 

for some nonzero S iR^. Using Lagrange multipliers we can prove 

(e^)^ = CTrninP 

Therefore, (j5.2p still holds true. 
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For the heat equation approximated using (|2.ip . the associated mappings 
can be defined by 

P^{n)=[u^,u^,.--,u^f, u^ = \ j'^ u{x) sin dx 
k=i ^ ^ 

If we want to find the observability of the first s modes, Definition [2] is 
equivalent to the analysis using the traditional observability gramian for 
N = s. In fact, for all > s, G is a constant matrix and 

G= r e^^'y\C'yC'e^''dt 
Jo 

Therefore, = for all > s and is consistent. 

The idea of gramian matrix can be applied to nonlinear systems as a 
first order approximation of observability. Let uf{t) and u^{t) be solutions 
of the ODE in ()3.1ip with initial value 

n±(0) = n^(0)±pef 

If the system is linear, we have 

n o <D^(e-^^*ef ) 

Therefore, if the ODE in p. lip is nonlinear, we can define 

Let amin be the smallest eigenvalue of G relative to 5, then ()5.2p is the first 
order approximation of the unobservability index. In this case, G is called an 
empirical gramian matrix. This approach is inspired by the computational 
method in [TO]. 



6 Nonlinear systems 

Consider a nonlinear initial value problem 

ut = F{t,u,Uj:,- ■ ■), mQx{to,ti] 
Bu = on dO,b X (to, ti] 

u = Uq in Q X {t = 0} 

y{t)=n{u{;t)) 



17 



where is an open set in JR", F is a continuous function of t, u, and its 
derivatives with respect to x. The function u{-,t) belongs to D, which is a 
subspace of a Banach space X. The boundary condition is defined by a set 
of hnear boundary operators on a part of dO,, denoted by 80,^. To take into 
consideration of the boundary condition, we define 



In the following, u{t) represents u{-,t) in Db- A solution u{t) for this prob- 
lem is a X valued function that is continuous in [to,ii], du/dt exists and is 
continuous for all t E (^0,^1], satisfying n(0) = uq, and u{t) S Db for all 
t G (0,ti]. We assume that (|3.ip is well posed. Proving the well-posedness 
of nonlinear PDEs is not easy. Nevertheless, for well posed problems the 
consistency of observability is guaranteed. In (j3.ip . y{t) = 'H{u{-,t)) repre- 
sents the output of the system in which T-L\s a. mapping, linear or nonlinear, 
from X to M^. The output y{t) G C([to,ti]) has a norm denoted by ||y||Y. 
Suppose 



is the space for estimation, which is a finite dimensional subspace oi Db 
generated by a basis {ei, 62, • • • , e^}. For any solution, u, of ()6.ip . similar to 
(j3.3p we can define its best estimate Uw & W and its remainder Ur- Following 
Definition [H the ratio p/e represents the unobservability index of u^,, where 



Db = {v e D\ Bv = on 8^1,} 



W = spanjei, 62, • • • 



es} 



e = mf\\niu)-nM\\Y 



(6.2) 



and u satisfies 



ut = F{t,u,Ux, • • •) 

u{t) e Db for ah t e (tc^i] 

u{0) G W 

MO) - u^{0)\\x = p 



(6.3) 



The approximation scheme consists of a sequence of ODEs 



du^/dt = F^{t,u^), u^eM- 




(6.4) 



and two sequences of linear mappings 



,N 




(6.5) 
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subject to 



The norm in is represented by || • Hat. Similar to the previous section, 
we assume that the approximation scheme is well posed. In each JR^, the 
space for estimation is defined by 

= span{ef,e^,---,ef} 

For any trajectory u^{t) of (j6.4p with u^[0) G W'^ , its unobservability 
index is defined by p/e^ in which 

= inf 11?^ o $^(n^) - n o $^(n^)||y 

du^/dt = F^{t,u^) 
u^{0) E (6.6) 
\\u^{0)-u^m\N = P 

For nonlinear systems, we need an additional assumption to guarantee 
the consistency. 

Convergence Assumption for <I>^: Given any sequence 

where v^{t) is a solution of (I6.4p with v'^ (0) G W'^ . If ^^{v^{0)) converges 
to u(0) G We, where u{t) is a solution of (j6.ip . then <I>^(f^(t)) converges 
to u{t) uniformly for t G [tO)*i]- 



This assumption is stronger than the well-posedness assumption 
because v^{0) is not required to equal P'^{u{0)). In many approximation 
schemes, the error satisfies 

for u{0) from a bounded set in W, where P'^ {u{0)) = ti^(O) and a > 
is a rate of convergence. In this case, it can be proved that Convergence 
Assumption for <I>^ is satisfied. 

Lemma 2 Suppose <I>^ satisfies Convergence Assumption. Given a se- 
quence n^(t), > Nq, satisfying /i6.b]) . There exists a subsequence, u^*'{t), 
such that {'^^'^{u^^)}^^i converges uniformly to a solution of 116.3]) . 
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Proof . For each u^{t) in Lemma [21 we have 



1=1 

for some constants a^, a^, • • •, . From the condition on the initial value 
in (j6.6p . we know that the set 



^afeflU, N>No} 



1=1 



is bounded. Then it can be proved that the sequence {(a(*^, o^, • • • , )'^}'n=No 
has a bounded subsequence that converges, 



Therefore 



lim «>^'=(u^HO)) 

i=l 

s 



i=l 

m 



From Convergence Assumption for <1>^, {^^'' {u^'')}kLi converges to u{t), a 
solution of the PDE in (16. 3p . The limit converges uniformly. Because 



||^^K0)-n^K0)||7V, =P 
and because of the consistency of the norms, we have 
\\u{0) - uiO)\\x 

s 

= lim II J]a,ef'=-i.^HO)||iV, 

2 = 1 

= lim ||^a^e^-^^HO)IU, 

1 = 1 

= P 

Therefore, {^'^'' {u^'')}'kLi converges uniformly to a solution of ()6.3p . □ 
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Theorem 2 Suppose the initial value problem h6.1\) and its approximation 
scheme \6.4\) - f6^) are well posed. Suppose satisfies Convergence As- 
sumption. Suppose % satisfies Output Continuity Assumption. Then, 

lim = e (6.7) 

Proof. Most part of the proof is similar to that of Theorem [T] except for 
a few places where the linearity property is used. First, we prove 

liminfe^>e (6.8) 

Suppose this is not true, then liminf < e. There exists a > and a 
subsequence A^'^ — )• oo so that 

N, 

e < e - a 

for all Nk- From the definition of e^, there exist u^''{t) satisfying ()6.6p such 
that 

\\no (n^fc ) - o (u^^ ) 1 1 y < e - a 

From Lemma O we can assume that <I>^'-'(n^*(t)) converges to u{t) uni- 
formly, where u{t) satisfies (j6.3p . From Output Continuity Assumption, 

lim \\n{^^^{u^^) -n{^^^{u^^)\\Y = \\n{u)-n{u)\\Y <e-a 
However, from the definition of e, we know 

e < \\n{u)-n{u)\\Y 

A contradiction is found. Therefore, (|6.8p must hold. 
In the next step, we prove 

lim sup e-^ < e (6-9) 

It is adequate to prove the following statement: for any a > 0, there exists 
iVi > so that 

e^<e + a (6.10) 

for all N > Ni. From the definition of e, there exists u satisfying ()6.3p so 
that 

\\H{u) - 'H{u)\\y < e + a (6.11) 
Let be a solution of the ODE 

d^x^M = F^(t,n^) 
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with an initial value 

Then the following limit converges uniformly 

hm ||$^(n^(0)-^i(t)|k = (6.12) 

A problem with ■u^(O) is that its distance to n^(0) may not be p, which is 
required by ()6.6p . Let u{i) be a solution of ()6.4p with an initial value 

u^(0) = 7^(ti^(0) - u^(0)) + u^(0) 

||u^(0)-«^(0)||,v 

Obviously 

||n^(0)-n^(0)||^ = /5 

and u{t) satisfies ()6.6p . Due to the consistency of the norms and the fact 
ll'u(O) — u(0)||x = /9, we know 

limAT^oo 7Af = 1 (6.13) 
From (I6.12P and (I6.13p . we have 
lim ^>^('u^(0)) 

= lim (7^($^(ti^(0))-$^(^x^(0)))+$^(n^(0))) 
= u(0) 

By Convergence Assumption for the limit 

lim <^^{u^{t)) = u{t) 

converges uniformly on the interval t £ [tQ,ti]. Then Output Continuity 
Assumption implies 

lim \\n{^^{u^))-n{<^^{u^mY 
= \\n{u)-'H{u)\\Y 

< e + Q 

There exits A^i > so that 



22 



for all N > Ni. From the definition of e^, we know 

< ||?^(cl>^(n^)) - ?^(<I>^(^x^))||y <e + a 

for all N > Ni. Therefore, ([62]) holds. 

To summarize, the inequalities (|6.8|) and (|6.9|) imply 

lim = e 



iV-i-oo 



n 



7 Example 

Consider the following Burgers' equation 

du(x,t) , .du(x,t) d'^u(x,t) 

+ U(X, t) = K- 



dt ' dx 
tt(x,0) = uo{x), 

u{0,t) = u{L,t) = 0, 



X G [0, L] 
tG[0,T] 



(7.1) 



where L = 2tt, T = 5, and k = 0.14. The following output represents three 
sensors that measure the value of u{x,t) at fixed locations 



' yi{ik) ' 






2/2 (tfc) 













, tk = kAt, fc = 0,1,2, 



(7.2) 



where At = T/N^, = 20. Figure [2] shows a solution with discrete sensor 
measurements marked by the stars. In the output space 

/ Nt \ 

\\y\\Y=(Y.(yl(k) + yl{k)+ylik))\ 

\k=0 / 

The approximation scheme is based on equally spaced grid-points 
xq = < xi < ■ ■ ■ < xn = L, 

where 



Ax = X. 



Xi = L/N. 
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Figure 2: A solution of Burgers' equation with sensor measurements 



System ()7.ip is discretized using a central difference method 



U 



N ,,N 



N 



N 



2Ax 



+ K- 



Ax2 



U 



N-1 



-U 



..N _ N 



N-1 



N-2 I '^N + ^7V-2 



where u, 



N _ ,,N 







2 Ax ' Ax2 
0. For any v{x) £ C^([0,L]), we define 

P^'iv) = [ v{xi) v{x2) ■ ■ ■ v{xN.i) ] G M^-' 

For any G define 

N/2~l 



Oo 

2 



fc=i 



27rA: \ , f 2Trk 
o-k COS I —^x + Ok sin ( —^—x 



L 



L 



+ 



aAf/2 



(7.3) 



cos 



'-kN 
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where 



2 ^ /2TTk 



N 



N-l 

E 



sm 



xj^, k = 0,l,2,--- ,N/2 
k = 1,2,--- ,N/2 - 1 



2'Kk 



(7.4) 



We adopt L^-norm in C^[0,L]. For any vector G M'^ ^, we defined its 
norm using the Fourier coefficients (j7.4p . 

N/2~l 
k=l 

From the orthogonahty of trigonometic functions, 

The space for estimation is defined to be 

Kf 



W = < 



/ 2kTT 2k'K \ 

ao/2 + 2^ I afc cos(-^x) + Pk sm(-^x) I 

k=i ^ ^ 



Kp 
k=l 



In this section, i^j? = 2. This means that we want to find the observability 
for the first five modes in the Fourier expansion of ti(0). Or equivalently, we 
would like to find the observability of 



Define 
then 



[ ao Oil /3i 02 h ] 



X = [ Xi X2 ■ ■ ■ XN-1 



W 



N 



ao/2 + 2 U cos(^X^) + /3, sin(^X^; 
k=i ^ 



Kf 

+ = 

k=l 



For this simulation, the nominal trajectory has the following initial value 

uq{x) = —2 + cos(x) + sin(x) + cos(2x) + sin(2x) 
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Its solution is shown in Figure [21 To approximate its observability, we apply 
the empirical gramian method to ()7.3p in the space . The consistency of 
observability is verified by the results. The ratio p/e^ is approximated for 
N = 4k, 5 < fc < 19. The value of unobservability index approaches (Figure 

ED 

p/e = 11.83 



11 - 

10.5- 
10- 



20 30 40 50 60 70 

Grid-points 



Figure 3: Consistency for Burgers' equation 



8 Conclusions 

A definition of observability using dynamic optimization is introduced for 
PDEs. The advantage of this definition is to resolve several issues and con- 
cerns about observability in a unified framework. More specifically, using the 
concept one can achieve a quantitative measure of partial observability for 
PDEs. Furthermore, the observability can be numerically approximated. A 
practical feature of this definition for infinite dimensional systems is that the 
observability can be numerically computed using well posed approximation 
schemes. It is mathematically proved that the approximated observability 
is consistent with the observability of the original PDF. A first order ap- 
proximation is derived using empirical gramian matrices. The consistency 
is verified using an example of a Burgers' equation. 

Acknowledgement: The author would like to express his gratitude to 



26 



Professor Arthur J. Krener for his comments and discussions on the observ- 
abihty gramian and unobservabihty index. The author would hke to thank 
Dr. Liang Xu for his suggestions and comments on potential applications in 
numerical weather prediction. 

References 

[I] , C. Canuto, M.Y. Hussaini, A. Quarteroni, T.A. Zang, Spectral Methods 
- Fundamentals in Single Domains, Springer- Verlag, Berlin, 2006. 

[2] S. E. Hohn and D. P. Dee, Observability of discretized partial differential 
equations, SIAM J. Numer. Anal., Vol. 25(3), 1988, 586-617. 

[3] J. P. Gauthier and I. A. K. Kupka, Observability and observers for non- 
linear systems , SIAM J. Control and Optimization, Vol 32, 975-994, 
1994. 

[4] E. Hille and R. S. Phillips, Functional Analysis and Semi-Groups, Am. 
Math. Soc, Providence, Rhode Island, 1957. 

[5] R. Hermann, A. Krener, Nonlinear controllability and observability, 
IEEE Trans on Automatic Control, Vol 22, 728-740, 1977. 

[6] A. Isidori, Nonlinear Control Systems, Springer- Verlag, London, 1995. 

[7] T. Kailath, Linear Systems, Prentice-Hall, Inc., Englewood Cliffs, N.J., 
1980. 

[8] W. Kang and L.Xu, Computational analysis of control systems using 
dynamic optimization, arXiv:0906.0215 v2. July, 2009. 

[9] 66. W. Kang and L. Xu, A Quantitative measure of observability and 
controllability, Proc. IEEE Conference on Decision and Control, Shang- 
hai, China, 2009. 

[10] A. J. Krener and K. Ide, Measures of unobservabihty, Proc. IEEE Con- 
ference on Decision and Control, Shanghai, China, December, 2009. 

[II] R. R. Mohler and C. S. Huang, Nonlinear data observability and infor- 
mation. Journal of the Franklin Institute, vol. 325, 1988, 443-464. 

[12] R. D. Richtmyer, Principles of Advanced Mathematical Physics, Vol. 1, 
Springer, New York, 1978. 



27 



[13] X. Xia and W. Gao, Nonlinear observer design by observer error lin- 
earization, SIAM J. on Control and Optimization, Vol 27, 1989, 199-216. 



[14] G. Zheng, D. Boutat, and J. P. Barbot, Single output dependent ob- 
servability normal form. SIAM Journal on Control and Optimal, Vol.46, 
No.6, PP. 2242-2255, 2007. 

[15] J. A. Infante and E. Zuazua, Boundary observability for the space semi- 
discretizations of the 1-d wave equation, Mathematical Modelling and 
Numerical Analysis, ESAIM: M2AN, Vol. 33(2), 1999, 407-438. 



28 



